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BACKGROUND OF THE INVENTION 
Field of the Invention 

20 The present invention broadly relates to systems for telephone caller identification, and 

more particularly, to a system and method to identify a telephone caller by performing voice 
recognition on the callee identification information spoken by the caller. 

Description of the Related Art 
25 Telephone communication has seen a phenomenal growth since its inception because of 

its extreme usefulness in today's world. It is hard, and almost impossible, to conceive a world 

without telephones. Telephones have almost become an integral part of a civilized society. 

However, the advances in telephony have brought with them some Tindesirable consequences. 

For example, when a called party (or "callee") does not wish to speak with a particular person or 
30 persons, any calls from these calling parties (or "callers") will be perceived by the callee as a 

major source of disturbance and annoyance. The callee may not wish to accept a telephone call 

from a particular caller for a variety of reasons, such as, callee 's preoccupation with an important 

task, callee' s desire for privacy, the caller is a telemarketer, etc. 

35 The callee may thus wish to selectively receive a call based on the prior determination of 

the identity of the caller. In other words, the called party may prefer to determine who the caller 

PI-460263.01 1 



is prior to receiving the call One obvious way to accomplish this is to route all the calls to a 
human operator who first determines the identity of the caller and then asks the called party 
(while putting the caller on hold) whether the call is to be accepted or not. If the called party 
indicates that the caller is an unwanted caller or the caller be connected to an automatic message 
5 recording system, the human operator may politely refuse the access to the callee and/or connect 
the caller to the message recording system. This approach, however, requires presence of a 
human operator which may not be desirable and cost-effective. Furthermore, some callers may 
perceive the inquiry by the operator of their names as offensive or rude. 

10 A second approach to pre-screen a caller is to provide the called party with a visual 

indication of the name of the caller so that the called party can determine whether to accept the 

^r!: call or not. A typical visual indication may be provided by subscribing to the caller name 

^; ■ identification service (also known as the 'calling name service'). However, the calling party may 

l^l ask the telephone service provider to "block" the transmission of the caller's name to the display 

15^ apparatus of the called party. In other words, the caller may easily circumvent the identity 

^ detection aspect of the calling name service. In such an event, the callee may not be able to avoid 

jrj * or screen the call without first speaking with the caller. 

In the third approach, an automatic caller screening device is employed to identify and 
20 screen the caller (if necessary) prior to forwarding the call to the called party. Fig. 1 illustrates 
how a prior art automatic digital call assistant 10 functions as a caller-screening interface 
between a calling party 12 and a called party 14. Such automatic call-screening devices may 
typically be employed in an organization where it may not be desirable to allow unfettered access 
by the outside callers to the called parties (i.e., the employees of the organization). Initially, the 
25 caller 12 dials the phone number of the called party 14 (step 15). The call assistant xxnit 10 first 
receives the call placed by the caller and automatically enters into an off-hook condition. This 
establishes a telephone communication link between the caller 12 and the digital call assistant 10. 

Thereafter, at step 16, the call assistant 10 generates, in a synthesized voice, a greeting 
30 and/or an announcement (e.g., "Thank you for caUing XYZ corporation. This is an automatic 
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answering service for Mr. ABC." ) followed by a query asking the caller to speak the caller's 
name (e.g., "Please tell me who you are," or "Please clearly speak your name."). In response to 
the name query by the call assistant unit 10 for the called party 14, the calling party 12 may 
either hang up or provide the caller's name at step 17. The spoken words constituting the caller's 
5 name are thus received by the digital call assistant 10 at step 17. To prevent the caller from 
disconnecting, the call assistant 10 may optionally play a second announcement (e.g., "Please 
hold on while I connect you to Mr. ABC," or "You are being connected to Mr. ABC. Please do 
not disconnect," or, simply, "Please hold for a moment.") at step 18. 

10 In the meantime (i.e., while the caller is on hold), at step 19, the digital call assistant 10 

creates a digital sound file (also referred to as a 'digital audio file') fi:om the spoken syllables 
received from the caller. The digital audio file may be a wave (".WAV") file. The .WAV file is 
then converted into a digital ASCII (American Standard Code for Information Interchange) text 
file at step 20. The ASCII text file is thus generated based on speech recognition of the speech 

15 uttered by the caller. Assuming that the caller's name is John Doe, the speech-to-text conversion 
at step 20 results in the ASCII text file sequentially containing (in hexadecimal notation) ASCII 
codes 4A, 4F, 48, 4E for letters "J", "O", "H" and "N" respectively; ASCII code 20 for the 
'blank' between the words "John" and "Doe"; and ASCII codes 44, 4F and 45 for letter "D", "O" 
and "E" respectively. Thus, the caller's name is represented within the call assistant 10 as a string 

20 of binary I's and O's. 

The call assistant 10 then queries, at step 21, a portion of a database that is associated 
with the called party to determine whether the called party has placed any restriction on the calls 
from that specific caller. The ASCII file containing the name of the caller is compared with other 

25 ASCII files within the database to find a matching name, i.e., to determine whether the caller is 
one of the proscribed callers. Here, Mr. ABC may identify (in the database) that calls from caller 
John Doe need not be forwarded to Mr. ABC. Alternatively, Mr. ABC may not put any 
restriction on the calls from caller John Doe. Thus, depending on the information in the database, 
the digital call assistant 10 may generate appropriate announcement at step 22. If the caller 12 is 

30 allowed to be connected to the called party 14, the announcement may state so (e.g., "You are 
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being connected to Mr. ABC. Please continue to hold."). On the other hand, if the caller 12 is not 
allowed to directly call the callee 14, the announcement may indicate that the called party 14 is 
unavailable to answer the phone (e.g., "Mr. ABC is not in his office at this time. Please enter "0" 
to access his voice mail-box," or, simply, "Sorry, Mr. ABC is not in his office. Goodbye."). If the 
5 caller 12 is allowed to proceed with the call, the call assistant 10 sets up a call to the called party 
14 at step 23. This directly connects the calling party 12 and the called party 14 and a telephone 
conversation between them proceeds at step 24 once the called party 14 answers the call. 

Even the speech recognition-based automated caller-screening approach described 
10 hereinbefore with reference to Fig. 1 has certain undesirable attributes to it. The initial inquiry of 
the caller's name may not be received favorably by a number of callers. Such an inquiry may 
instead be perceived as unduly intrusive and as requiring information about caller's personal 

pit 

identity in an unnatural way and at a time when it may be too premature and awkward to ask the 
r =^ caller's name. Furthermore, if a caller always gets an announcement that the called party is 

1 5 imavailable to take the phone call after every interaction with the digital call assistant (including 
^ ' caller's self-identification every time the caller interacts with the digital call assistant), the caller 

may start suspecting that the called party is screening the caller based on the self-identification 
fll information provided by the caller. Such a negative impression by the caller may not be 
Ifi desirable, especially when there is a professional relationship between the caller and the callee. 
^ 20 

It is therefore desirable to automatically screen a caller without asking the caller to 
identify himself/herself. It is also desirable that the screening of the caller takes place in a manner 
that the caller perceives as a more natural way of telephone communication. 
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SUMMARY OF THE INVENTION 



According to the present invention^ a method of screening a caller prior to establishing a 
telephone connection between the caller and a callee comprises receiving a telephone call from 
5 the caller; prompting the caller to speak the name of the callee; receiving the name of the callee 
when spoken by the caller; and identifying the caller by analyzing the voice of the caller received 
when the caller speaks the name of the callee. The caller is prompted in a synthesized voice to 
speak the name of the callee. When the caller speaks the name of the callee, the analog voice 
signals are converted into a digital sound file. A set of one or more voice exemplars is then 
10 generated from this digital sound file. Thus, caller's voice is captured as a set of voice exemplars 
that is compared with different voice samples stored in a database to determine the identity of the 
caller. 

In one embodiment, the callee is identified by converting the digital sound file created 
15 when the caller announces the name of the callee into a digital text file, e.g., an ASCII file. This 
digital text file is then compared with other digital text files stored in the database carrying 
identification information, e.g., names, of different callees. The callee with the matching text file 
is then considered the recipient of the telephone call placed by the caller. 

20 A digital call assistant system according to the present invention includes a voice 

recognition unit that receives the caller's voice and analyzes it using voice recognition 
techniques. The voice recognition unit also generates the voice exemplars fi*om the digital sound 
file created fi:om the caller's voice. The database is coupled to the voice recognition unit to 
receive the caller's voice exemplars and also to perform the comparison of various voice samples 

25 under control of the voice recognition unit. 

A call routing module is provided as part of the digital call assistant system to route the 
caller's call to a destination specified by the voice recognition unit. When the voice recognition 
unit determines, with the help of the database, that the caller is one of the callers authorized to 
30 directly place a call to the called party (i.e., the callee), the voice recognition unit instructs the 
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call routing module to route the caller's call to the called party's telephone unit. However, if the 
caller is found to be one of those callers not authorized to directly place a call to the callee, then 
the voice recognition unit instructs the call routing module to route the call to an automated 
message recording system where the caller can leave a voice message for the callee. In one 
5 embodiment, the voice recognition unit may instruct the call routing module to simply 
disconnect the telephone call if the caller is one of the unauthorized callers. 

A subscription-based caller-screening service may be provided by a telephone service 
(wireline or wireless) provider using the digital call assistant system of the present invention. In a 

10 wireUne telephone service, the electronic switch in a telephone company central office or in a 

private branch exchange (PBX) may be modified to include the voice recognition module as well 
as the call routing module. The central office or PBX may further include the database and the 
message recording system. In a wireless telephone service, a mobile switching center may 
include the call routing module whereas an intelligent peripheral may be configured to 

15 implement the voice recognition module, the database unit and, optionally, the message 
recording system. 

Initial storage (in the database) of voice samples of different callers may be accomplished 
with instructions received from the called party. Thus, the called party may decide whose voice 

20 samples need be stored and, hence, which caller is to be authorized to directly place a call to the 
callee. In the present invention, caller identification and screening is accomplished without 
forcing the caller to identity himself/herself, which may be perceived as rude or offensive by 
some callers. Instead, the caller is asked to identify who the caller wishes to speak with. Caller's 
response to this query is used to identify the callee as well as to optionally identify the caller. 

25 Thus, the screening of the caller takes place in a manner that the caller perceives as a more 

natural way of telephone communication. In the present invention, the caller is identified using a 
voice-to-voice comparison method instead of a voice-to-text conversion followed by a text-to- 
text comparison method of the prior art. 

30 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Further advantages of the present invention may be better understood by referring to the 
following description taken in conjunction with the accompanying drawings, in which: 

5 

Fig. 1 illustrates how a prior art automatic digital call assistant functions as a caller- 
screening interface between a calling party and a called party; 

Fig, 2 depicts an exemplary setup where a digital call assistant system according to the 
1 0 present invention is interfaced between the calling party and the called party to screen the caller; 

Fig. 3 illustrates an exemplary implementation of various modules of the digital call 
assistant system according to the present invention in a telephone company central office or in a 
PBX; 

15 

Fig. 4 illustrates an exemplary implementation of various modules of the digital call 
assistant system according to the present invention in a wireless telephone network; 

Fig. 5 shows how the digital call assistant system according to the present invention 
20 functions as a caller-screening interface between the calling party and the called party; and 

Fig. 6 is a flow diagram depicting how caller's initial voice samples and caller identity 
information are stored for later caller-screening operation. 

25 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 



Referring now to Fig, % an exemplary setup is depicted where a digital call assistant 
system (DC AS) 25 according to the present invention is interfaced between the calling party (or 
5 "caller") 12 and the called party (or "callee") 14 to screen the caller 12. The calling party 

telephone 26 is shown connected to the DCAS 25 via a telephone line 27. The callee telephone 
unit 28 is shown connected to the DCAS 25 via a telephone Une 29. 

The caller 12 may place a call and, hence, communicate with the callee 14 (and also with 
1 0 the DCAS 25) by using a handset 3 1 and a keypad 32 provided on the telephone unit 26. The 

callee telephone unit 28 may have a handset 33 and a keypad 34 to allow the callee 14 to place an 
outgoing call or to receive an incoming call. As described hereinbelow, the callee 14 may also 
notify the DCAS 25, using the keypad 34, about the identity of one or more callers who need be 
blocked from directly accessing the callee' s telephone unit 28. In one embodiment, the callee 
15 telephone unit 28 is also provided with a display screen 36 so that one or more messages may be 
displayed thereon. For example, after identifying the caller, the DCAS 25 may display the 
caller's name on the screen 36, thereby visually informing the callee 14 of the identity of the 
caller 12. The visual indication may be desirable, for example, when the callee 14 wishes not to 
respond to the call (even if the call from that specific caller is not blocked) without actually 
20 lifting the handset 33 and, hence, without informing the caller 12 of the callee' s presence. 

A message recording system 38 may be connected to or made part of the DCAS 25 in the 
event that the caller 12 is refiised direct access to the called party 14 and the caller 12 wishes to 
leave a voice message for the called party 14, or in the event that the callee 14 is unavailable or 

25 does not wish to communicate with the caller 12 even when the caller 12 is not one of the 
proscribed callers refiised direct access to the called party 14. The DCAS 25 may inform the 
caller 12 of the option to leave a voice message for the callee 14 and may request the caller 12 to 
enter a specific digit (between "0" to "9") and/or a specific symbol (* or #) from the keypad 32 
so as to enable the DCAS 25 to direct the call to the message recording system 38. In a large 

30 organization, the message recording system 38 may have mailboxes for each individual 
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employee of the organization. The message recording system 38 may either store the messages in 
a digital form (e.g., on a RAM (random access memory) chip) or in an analog form (e.g., on an 
audio cassette tape or any other magnetic storage medium). 



5 The digital call assistant system 25 according to the present invention is shown to include 

three components: a caller voice recognition (VR) module 40, a call routing (CR) module 42 and 
a database and comparator (DC) unit 44. The VR module 40 identifies the caller 12 with the help 
of the DC unit 44 and instructs the CR module 42 where to route the call to, i.e., whether to the 
called party's telephone 14 or to the message recording system 38, or whether to disconnect the 

1 0 call from a specific caller. 

As described in more detail hereinbelow, the screening or identification of the caller is 
performed using voice recognition techniques. Generation of voice samples (or voice exemplars) 
of the caller's voice is performed when the caller 12 speaks the called party's name when 

1 5 prompted by the VR module 40. Caller's voice exemplars are then compared with earlier-stored 
voice exemplars in the DC unit 44 and a decision is made as to the identity of the caller 12. The 
DC unit 44 thereafter determines whether the caller 44 is authorized to directly contact the called 
party 14 and informs the VR module 40 of its decision. The VR module 40 then instructs the CR 
module 42 as to further processing of the call, i.e., whether to direct the call to the called party's 

20 telephone unit 28 or to the message recording system 38, or whether to disconnect the call. The 
caller 12 is thus requested to identify the called party 14 and the response of the caller 12 is used 
to identify the caller, without ever asking the name of the caller 12. 

Fig. 3 illustrates an exemplary implementation of various modules of the digital call 
25 assistant system 25 according to the present invention in a telephone company ("telco") central 
office or in a PBX. The same reference numeral '48' is used to refer either to the central office 
facility or to the PBX in an organization. It is noted that a telephone service provider may 
provide the caller-screening service (as described in more detail hereinbelow) to the telephone 
service subscribers either as part of the basic telephone service or as an extra service for 
30 additional cost. 
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The caller's telephone 26 may be connected to the DC AS 25 through a switch 46 in the 
telco central office or PBX (private branch exchange) 48. A PBX may be present in an 
organization or a corporation having a large number of internal telephone units. A call placed by 
5 the caller 12 (using the telephone 26) may thus be routed to the DCAS 25 through the switch 46. 
The callee telephone unit 28 may also be connected to the DCAS 25 through the telco central 
office or PBX 48 as illustrated in Fig. 3, The DCAS 25 may be a part of the central office or 
PBX 48. In that case, a call placed by the caller 12 is first received at the PBX 48, and the DCAS 
25 within the PBX 48 is activated upon the receipt of the phone call to execute a caller-screening 
10 operation prior to forwarding the call (if applicable) to the appropriate callee 14 (i.e., to the 
callee' s telephone unit 28), 

The VR module 40 and the CR module 42 may be implemented in software. When the 
DCAS 25 is part of a telco central office or a PBX 48, the software that implements the CR 

1 5 module 42 as well as the software that implements the VR module 40 may reside in a switching 
unit or switch (or "electronic switch") 46 within the central office or PBX 48. The DC unit 44 
may be an independent computer system residing within the central office or PBX facility 48 as 
depicted in Fig. 3. This computer system may be modified to also implement the fimctionality of 
the VR module 40. In that event, the switch 46 may implement only the CR module 42. The 

20 computer system (with VR module 40 and DC unit 44) may then be connected to the electronic 
switch 46. Similarly, the message recording system 38 may also optionally be included as part of 
the central office or PBX facility 48. The VR module 40 may include voice recognition software 
developed by a number of commercial vendors such as, for example, the IBM Corporation or the 
Dragon Systems, Inc. of 320 Nevada St., Newton, MA, USA 02460. 

25 

In one embodiment, the software that implements the VR module 40 may reside on a 
computer system that also implements the DC unit 44. Such a computer system may be located 
external to the central office or PBX facility 48. In other words, the central office or PBX 48 may 
implement only the CR module 42 ftinctionality through the switch 46. Other alternative 
30 arrangements may also be devised. 



10 



Fig, 4 illustrates an exemplary implementation of various modules of the digital call 
assistant system 25 according to the present invention in a wireless telephone network 50. The 
wireless telephone network 50 may employ a TDMA (time division multiple access), a CDMA 

5 (code division multiple access) or any other mobile telecommunication standard. In the 
embodiment depicted in Fig. 4, the calling party telephone unit 26 is shown connected to a 
wireline telephone network, e.g., the PSTN (public switched telephone network) 52, which, in 
turn, is connected to a mobile switching center (MSG) 54 associated with the called party's (i.e., 
the mobile subscriber's) home location register (HLR) (not shown) in the wireless network 50. 

10 Of course, the calling party 12 may be using a wireless telephone and the called party 14 may be 
using a wireline telephone, or both parties 12, 14 may be using wireless telephones. The 
functionality of the MSG 54 may be analogized with that of the switch 46 in a wireline network 
illustrated in Fig. 3. Thus, a call placed by the caller 12 is routed (via the PSTN 52) to the MSG 
54, which, in turn, establishes a telephone connection between the calling party telephone unit 26 

15 and the called party's handset 56. 

Similar to a wireline telephone service provider, a wireless telephone network operator 
may also provide the caller-screening service to wireless service subscribers either free of charge 
or for an additional cost. In such an event, the software for the GR module 42 may reside in the 

20 MSG 54. Furthermore, the software that implements the fimctionality of the VR module 40 and 
the DG unit 44 may reside in a computer system 58 that is external to the switching mechanism, 
i.e., the MSG 54. The computer system 58 may be part of an enhanced platform, e.g., an 
intelligent peripheral unit (IP) 60. The IP 60 may also provide storage to implement the optional 
message recording system 38. The mobile subscriber (i.e., the called party) 14 may access the IP 

25 60 (using, e.g., an access code) to retrieve voice messages stored therein for the mobile 

subscriber 14. In an alternative embodiment, the software for the VR module 40 may reside in 
the MSG 54, which may be modified to execute the software upon receiving a call destined for 
the mobile subscriber 14; the DG unit 44 and the optional message recording system 38 may still 
be implemented via the intelligent peripheral 60. Alternative arrangements using other fimctional 
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entities of the wireless network 50 (e.g., the HLR (home location register), the SCP (signaling 
control point), etc.) to implement one or more modules of the DCAS 25 may also be devised. 

The functionality of the DCAS 25 according to the present invention may be 
5 implemented in an AIN (advanced intelligent (telephone) network) also. An SSP (service 

switching point) switch (not shovm) in the AIN may be configured to implement the CR module 
42, whereas an SN (service node) (not shown) within the AIN may be configured to implement 
the VR module 40 as well as the DC unit 44. The SN may further implement the optional 
message recording system 38, if desired. An ISDN (integrated services digital network) service 
10 provider may also offer the caller-screening service according to the present invention as part of 
the service package. An arrangement similar to that shown in Fig. 3 may be made in an ISDN 
central office (not shown) to implement the functionality of the DCAS 25. 



It was noted hereinbefore that the VR module 40 uses voice recognition to identify the 
15 caller 12. In voice recognition, various parameters (e.g., pitch, amplitude, etc) in one or more 
voice exemplars extracted from the current speech of a speaker are compared with similar 
parameters for prior voice samples (of different speakers) stored in a database. When a voice 
sample is found that has the maximum number of parameters matching v^th the current set of 
voice exemplars, the speaker associated with the matching voice sample is determined to be the 
20 speaker of the current speech. The speaker is thus identified based on a prior record of the 
distinguishing parameters in that speaker's speech pattern. A voice recognition system may 
therefore be considered as a speaker-dependent system as opposed to a simple speech recognition 
system, which may be speaker-independent. 

25 Referring now to Fig. 5, it is shown therein how the digital call assistant system 25 

according to the present invention functions as a caller-screening interface between the calling 
party 12 and the called party 14. Initially, at step 62, the caller 12 places a call to the callee's 
telephone number. This call is received and processed by the VR module 40 in the DCAS 25. 
The VR module 40 establishes an off-hook condition and plays (in a synthesized voice) a 

30 greeting/annoxmcement at step 64. The greeting/announcement may be similar to that described 
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hereinbefore with reference to step 16 in Fig. 1. Immediately after the initial 
announcement/greeting, the VR module 40 prompts the caller 12, in a synthesized voice, to 
identify the called party 14 (e.g., "Who do you wish to speak to?" or "Please clearly speak the 
name of the party you wish to speak to."). In response, the caller 12 speaks, at step 66, the 
5 callee's name into the microphone (not shown) of the handset 31 (Fig, 2). The caller's speech is 
converted into electrical signals by the microphone (not shown) of the handset 3 1 and sent to the 
VR module 40 via the telephone line 27 (Fig. 2). The VR module 40 may optionally play a 
second announcement at step 68 (similar to the one mentioned hereinbefore with reference to 
step 18 in Fig. 1) while the VR module 40 performs voice recognition operation on the caller's 
10 speech signals. 

It is noted that it is not unusual for a caller to expect a human or an automated operator to 
ask the caller who the caller wishes to speak to. Therefore, asking the caller to identify the called 
party is a more natural way of telephone conmiunication as compared to the prior art methods of 
1 5 forcing the caller to identify himselfTherself 

At step 70, the VR module 40 creates a digital audio or sound file from the caller's audio 
speech signals received over the telephone Une 27. The format for the digital audio file may 
include one of a number of file extensions such as, for example, ".WAV" (wave file), 

20 ".AIFF"(Audio Interchange File Format), ".AU"(audio file), etc. After generating a sound file, at 
step 72, the VR module 40 creates one or more voice samples or voice exemplars for the caller's 
voice from that sound file with each sample having a predefined set of parameters (e.g., pitch, 
amplitude, etc.) to be mathematically analyzed to identify salient characteristics of the caller's 
voice. The voice exemplars are created using digital signal processing techniques as applied to 

25 voice recognition. At step 74, the VR module 40 sends the set of one or more voice exemplars to 
the DC unit 44 to query whether matching voice samples exist in the DC unit 44. A description 
of storage of voice samples in the DC unit 44 is given hereinbelow with reference to Fig. 6. 

The DC unit 44, under program control by the VR module 40, compares the voice 
30 exemplars received from the VR module 40 with those stored therein for statistically optimal 
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prediction of the identity of the caller 12, In one embodiment, the DC unit 44 may store only the 
voice samples (without corresponding identity information) of all those callers who have been 
allowed (by the callee) to directly speak with the callee. In such an embodiment, the DC unit 44 
may simply check whether the voice samples from the VR module 40 match with any samples 
5 stored therein. If a match is found, the DC unit 44 may send a response to the VR unit 40, which, 
in turn, may inform the caller 12 (through the third announcement at step 76) that call is being 
forwarded to the callee 14. The VR module 40 may then instruct the CR module 42, at step 78, to 
transfer the call to the callee's telephone unit 28 (Fig, 2) or 56 (Fig. 4). At step 80, the caller 12 
may establish a telephone conversation with the callee 14 if the callee 14 picks up the telephone 
1 0 handset 33 and responds to the call. 

In an altemative embodiment, caller's identity may be determined at the same time when 
the voice samples from the VR module 40 are compared with voice exemplars stored in the DC 
imit 44. Here, the DC unit 44 may include identity information (e.g., name of the caller, name of 

15 the caller's company or employer, etc.) stored as a digital text file (e.g., an ASCII text file) along 
with corresponding voice exemplars for a particular caller 12. Therefore, upon finding a 
statistically allowable match between the presently-received voice exemplars from the VR 
module 40 and those stored in the DC unit 44 for a particular caller, the DC unit 44 may send to 
the VR module 40, as part of its response, the information identifying the caller 12 (e.g., by 

20 name) as well as an indication whether the caller 12 is one of the "authorized" callers or one of 
the "proscribed" callers. 

The DC unit 44 may store voice exemplars of only those callers who have been given 
direct access to the callee 14 in the past. In such an event, all the DC unit 44 has to do is to 
25 inform the VR module 40 that a matching voice sample has been found and transmit the caller 
identity information to the VR module 40. The VR module 40 may, in turn, initiate two actions 
simultaneously: one to place the announcement at step 76 and the other to instinct the CR 
module 42 to setup a call at step 78. Thus, steps 76 and 78 may be performed simultaneously. 
The telephone conversation at step 80 may then proceed once the callee 14 responds. 

30 



14 



As noted hereinbefore, the announcements at steps 68 and 76 may be similar to the 
exemplary announcements given hereinbefore with reference to steps 18 and 22 (Fig. 1) 
respectively. In any event, if the caller 12 is not allowed to be directly connected to the callee 14 
(i.e., when no matching voice samples are found or when the DC unit 44 indicates that the caller 
5 12 one of the proscribed callers), then the announcement at step 76 may inform the caller 12 of 
the option to store a voice message for the callee 14 and instruct the caller 12 to place certain 
digit(s) and/or symbol(s) on the keypad 32 to enter the callee' s voice mailbox in the message 
recording system 38. Upon receipt of the appropriate selection, the VR module 40 may instruct 
the CR module 42 to connect the caller 12 to the message recording system 38. 

10 

Thus, the VR module 40 may not only route the caller's call to appropriate callee 14 
identified through voice recognition techniques described hereinbefore, but may also route 
information about caller's identity along with the ringing signal to the called party's telephone 
unit 28 (Fig. 2) or 56 (Fig. 4). The identity of the caller 12 is determined without the need to ask 
15 the caller 12 to identity himself/herself (which may be embarrassing for a number of callers) and 
without the caller 12 knowing that callee 14 has been informed of the caller's identity. The 
caller's identity information may be routed over the telephone line 29, and the callee' s telephone 
unit (e.g., the telephone unit 28 in Fig. 2) may display such information on a display screen (e.g., 
the screen 36 in Fig. 2). The display screen may be an LCD (liquid crystal display) screen, 

20 

Turning now to Fig, 6, a flow diagram depicting how caller's initial voice samples and 
caller identity information are stored for later caller-screening operation is shown therein. The 
functionality of the VR module 40 and the DC unit 44 may be combined to implement the flow 
diagram illustrated in Fig. 6. In other words, a voice-recognition software (in the VR module 40) 
25 and a database (e.g., a computer memory on a hard disk drive) interacting with the VR module 
40 may perform the operations depicted in Fig. 6 to create a set of voice exemplars for future 
comparison and caller-screening as described hereinbefore. 

Initially, at step 82, the voice recognition software (in the VR module 40) may wait for an 
30 indication by the callee 14 (Fig. 2) to collect voice samples of the caller 12. At step 84, the callee 
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14, via the keypad 34, may instruct the voice recognition (VR) software to create voice samples 
for the caller 12 with whom the callee 14 is presently conversing or for any future calls the callee 
14 receives from different callers. If no call is received, the VR module 40 may wait for a call at 
step 85. Thus, the callee 14 may initiate the voice-sample creation process at any time during a 
5 current telephone conversation or prior to a telephone conversation so long as a predefined 

access code (e.g., *12 or #9) is entered by the callee 14 through the keypad 34. The DTMF (dual 
tone multi frequency) audio tones transmitted over the telephone line 29 by the entry of the 
access code may be suppressed in the CR module 42 so that the caller 12 may not hear them if a 
conversation is in progress. 

10 

Once the collection of voice samples feature is activated by the callee 14 (at step 84) and 
as soon as a call is received from a caller 12 or so long a call is in progress, the VR module 40 
initiates creation of caller's voice samples at step 86. The electrical audio speech signals received 
from the caller 12 over the telephone line 27 (Fig. 2) are periodically sampled and converted into 

15 corresponding digital signals and the sampled data is stored into a digital audio file, which can be 
similar to that described hereinbefore with reference to step 19 (Fig. 1) and step 70 (Fig. 5). 
Caller's voice samples are then extracted from this digital audio file using statistical digital 
signal processing techniques. Human voice parameters such as pitch, amplitude, intonation, etc., 
may be considered while creating a set of voice samples for a particular caller 12. The resulting 

20 set of voice samples or voice exemplars is stored in the database 44 at step 88. When more than 
one called party shares the same DCAS 25 (Fig. 2), the VR module 40 may inform the database 
44 of the name or telephone extension number of the called party 14 for whom the voice 
exemplars are being stored. This allows the DC unit 44 to later identify appropriate caller 12 for 
a given callee 14. 

25 

The VR module 40 may continue generating voice samples for different callers until the 
collection of voice samples is deactivated by the callee 14 at step 94. Upon deactivation (by the 
callee 14) of voice sample collection process, the voice recognition software (in the VR module 
40) ends, at step 96, the monitoring of the telephone line 27 for caller's voice. 

30 
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Two optional process steps 90 and 92 may also be carried out (by the VR module 40) as 
illustrated in Fig. 6, If caller screening is desired in addition to caller's voice-based call routing, 
the VR module 40, at step 90, may prompt the callee 14 at the completion of the current phone 
conversation v^ith the caller 12 to provide information about caller's identity. The callee 14 may 
5 speak the caller's name and other identifying information (e.g., caller's corporation or caller's 
employer) into microphone (not shown) of the handset 33 (Fig. 2), and the VR module 40 may 
convert the spoken information into a digital text file, e.g., an ASCII text file, at step 92. The VR 
module 40 then sends the digital text file to the DC unit 44 to be stored along with the set of 
voice exemplars just created for a given caller 12. This caller-identifying information may later 
1 0 be received by the VR module 40 (fi-om the DC unit 44), which, in turn, may instruct the CR 
module 42 to display, for example, the caller's name on the display screen 36 (Fig. 2) or to 
transmit an announcement (in synthesized voice) of the caller's name via intercom facility if the 
called party's telephone 28 is equipped with intercom features. 

15 In an altemative embodiment, the called party 14 may simply enter the identity 

information for the caller 12 using the DTMF keypad 34 (Fig, 2). The entered information may 
be displayed on the display screen 36 and any necessary correction may be made by the called 
party 14 prior to sending the information to the VR module 40 for storage in the DC unit 44 
using one or more keys, e.g., * or #, on the keypad 34. In another embodiment, the called party 

20 14 may be able to instruct the VR module 40 to delete (either using the keypad 34 or a voice 

command recognizable by the VR module 40) voice samples most-recently stored in the DC unit 
44. An advanced DCAS system 25 may support deletion of any caller's voice samples fi:om the 
DC unit 44. In the absence of a caller's voice samples in the DC unit 44, the caller 12 may not 
get directly connected to the called party 14, but, instead, may get connected to the message 

25 recording system 38 as discussed hereinbefore. 

The digital call assistant system 25 according to the present invention may be integrated 
in each called party's telephone unit (e.g., the telephone unit 28), In such an event, the telephone 
company central office, a PBX or a wireless network may not need to implement the 
30 functionality of the call assistant system 25. Individual callee telephone unit may itself screen the 
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caller prior to generating a ringing sound, thereby informing the callee 14 of the presence of a 
telephone call only in the event that the caller 12 is determined to be one of the callers who is 
"authorized" to directly talk to the callee 14. Similarly a telephone answering machine (not 
shown) (e.g., an analog or digital answering machine internal or external to a telephone unit) or a 
5 telephone answering system in an organization may be modified to include a built-in DC AS 25. 
In such an application, the answering machine or the answering system with built-in DCAS 25 
may "recognize" the caller and then allow only pre-selected callers to record messages. Upon 
identifying the caller as one of the proscribed callers, the answering machine or the answering 
system may simply disconnect the telephone line. Thus, unwanted callers (e.g., telemarketers) 
1 0 may be prevented from directly calling or leaving messages for the callee. 

The foregoing describes exemplary embodiments of a call-routing and caller-screening 
system that employs voice recognition to automatically recognize a caller's voice and then screen 
a caller, if appropriate; all without forcing the caller to identity himself/herself, which may be 

15 perceived as rude or offensive by some callers. Instead, the caller is asked to identify who the 

caller vdshes to speak with. Caller's response to this query is used to identify the callee as well as 
to optionally identify the caller. Thus, the screening of the caller takes place in a manner that the 
caller perceives as a more natural way of telephone communication. Caller's speech is not 
converted into a digital text file nor is it stored as such a text file. Instead, caller's speech is used 

20 to generate digital voice samples therefrom and the caller's voice samples are directly compared 
with other voice samples stored in a database. In the present invention, the caller is identified 
using a voice-to-voice comparison method instead of a voice-to-text conversion followed by a 
text-to-text comparison method of the prior art. 

25 While several embodiments of the invention have been described, it should be apparent, 

however, that various modifications, alterations and adaptations to those embodiments may occur 
to persons skilled in the art with the attainment of some or all of the advantages of the present 
invention. It is therefore intended to cover all such modifications, alterations and adaptations 
v^thout departing from the scope and spirit of the present invention as defined by the appended 

30 claims. 
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What is claimed is: 



1 . A method of screening a caller prior to establishing a telephone connection between the caller 
and a callee, the method comprising: 

receiving a telephone call from the caller; 
prompting the caller to speak the name of the callee; 
receiving the name of the callee when spoken by the caller; and 

identifying the caller by analyzing the voice of the caller received when the caller speaks 
the name of the callee. 

2. The method of claim 1, further comprising: 

determining whether the caller is authorized to be directly connected to the callee; and 
routing the telephone call to a telephone terminal for the callee if the caller is authorized 
to be directly connected to the callee. 

3. The method of claim 2, further comprising routing the telephone call to a message recording 
system if the caller is unauthorized to be directly cormected to the callee. 

4. The method of claim 2, further comprising disconnecting the telephone call if the caller is 
unauthorized to be directly connected to the callee. 

5. The method of claim I, wherein prompting the caller to speak the name of the callee is done 
using a synthesized voice. 

6. The method of claim 1, wherein receiving the name of the callee includes receiving electrical 
audio signals representing the name of the callee as spoken by the caller. 

7. The method of claim 1, further comprising creating a database containing multiple sets of 
digital voice samples, wherein each set within the multiple sets contains at least one digital 
voice sample for a different one of a plurality of callers. 
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8. The method of claim 7, wherein identifying the caller includes: 

creating a test set of voice samples from the voice of the caller received when the caller 

speaks the name of the callee; and 
individually comparing the test set of voice samples with the each set of voice samples 
in the database to identify whether the caller is one of the plurality of callers. 



9. A method of routing a telephone call to a callee comprising: 

receiving the telephone call from a caller; 
prompting the caller to speak the name of the callee; 
receiving the name of the callee when spoken by the caller; 

identifying the callee by analyzing the voice of the caller received when the caller speaks 

the name of the callee; and 
routing the telephone call to the callee so identified. 

10. The method of claim 9, fiirther comprising routing the telephone call to a message recording 
system if the callee is unable to receive the telephone call. 

1 1 . The method of claim 9, wherein prompting the caller to speak the name of the callee is done 
using a synthesized voice. 

12. The method of claim 9, wherein receiving the name of the callee includes receiving electrical 
audio signals representing the name of the callee as spoken by the caller. 

13. The method of claim 9, fiirther comprising creating a database containing a plurality of 
digital text files, wherein each of the plurality of digital text files contains identification 
information for a different one of a plurality of callees. 

14. The method of claim 13, wherein the each of the plurality of digital text files is in ASCII 
format, and wherein the identification information includes the name of the callee. 
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15. The method of claim 14, wherein the identification information further includes a telephone 
extension number for the callee. 

16. The method of claim 13, wherein identifying the caller includes: 

converting the name of the callee as spoken by the caller into a test digital text file; and 
individually comparing the test digital text file with the each of the plurality of digital 
text files in the database to identify the callee. 

17. A digital call assistant system interfaced between a first telephone unit operated by a caller 
and a second telephone unit operated by a callee, the digital call assistant system comprising: 

a voice recognition module coupled to the first telephone imit, wherein the voice 

recognition module is configured to receive a telephone call from the caller and in 
response prompt the caller to speak the name of the callee; and 

a database unit coupled to the voice recognition module, wherein the database unit is 

configured to store therein multiple sets of digital voice samples, wherein each set 
within the multiple sets contains at least one digital voice sample for a different 
one of a plurality of callers. 

18. The digital call assistant system of claim 17, wherein the voice recognition module is 
configured to prompt the caller using a synthesized voice. 

19. The digital call assistant system of claim 17, wherein the voice recognition module is 
configured to receive the name of the callee when spoken by the caller and to create a test set 
of voice samples from the voice of the caller received when the caller speaks the name of the 
callee, wherein the voice recognition module is further configured to instruct the database 
xmit to individually compare the test set of voice samples with the each set of voice samples 
stored therein to identify whether the caller is one of the plurality of callers. 
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20. The digital call assistant system of claim 19, further comprising a call routing module 
coupled to the voice recognition module, wherein the call routing module is configured to 
route the telephone call to a destination specified by the voice recognition module. 

21. The digital call assistant system of claim 20, wherein the voice recognition module is 
configured to determine whether the caller is authorized to dnectly place the telephone call to 
the second telephone unit prior to specifying the destination to the call routing module. 

22. The digital call assistant system of claim 20, wherein the destination includes one of the 
second telephone unit; and a message recording system for the caller to leave a voice 
message for the callee. 

23. The digital call assistant system of claim 20, wherein the call routing module is implemented 
in one of the following: 

a switch in a telephone company central office; 
a switch in a private branch exchange; 

an SSP (service switching point) switch in an advanced intelligent network; and 
a mobile switching center in a wireless network. 

24. The digital call assistant system of claim 17, wherein the database unit is configured to store 
a plurality of digital text files, wherein each of the plurality of digital text files contains 
identification information for a different one of a plurality of callees. 

25. The digital call assistant system of claim 24, wherein the voice recognition module is 
configured to receive the name of the callee when spoken by the caller and to convert the 
name of the callee as spoken by the caller into a test digital text file, and wherein the voice 
recognition module is further configured to instruct the database unit to individually compare 
the test digital text file with the each of the plurality of digital text files in the database to 
identify the callee. 
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26. The digital call assistant system of claim 17, wherein the voice recognition module 
implemented in one of the following devices: 
an intelligent peripheral in a wireless network; 
a switch in a telephone company central office; 
a switch in a private branch exchange; and 
a service node in an advanced intelligent network. 



23 



ABSTRACT OF THE DISCLOSURE 



A system and method of call-routing and caller-screening that employs voice recognition 
to automatically recognize a caller's voice and then screen a caller, if appropriate; all without 
forcing the caller to identity himself/herself, v^hich may be perceived as rude or offensive by 
some callers. Instead, a synthesized voice automatically asks the caller to identify v^ho the caller 
wishes to speak with. Caller's response to this query is used to identify the callee as well as to 
optionally identify the caller. Thus, the screening of the caller takes place in a manner that the 
caller perceives as a more natural way of telephone communication. Caller's speech is used to 
generate digital voice samples therefrom and the caller's voice samples are directly compared 
with other voice samples stored in a database without converting the voice samples into digital 
text files. Present methodology is particularly useful when it is desired to limit one or more 
caller's direct access to the called party as well as to identify a caller before the called party 
wishes to proceed v^th the call. The digital call assistant system of the present invention may be 
implemented, for example, in a telephone company central office, in a PBX in an organization or 
as part of a wireless network. Subscription-based automatic caller-screening service may also be 
provided by a telephone service provider using the call assistant system of the present invention. 
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